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• PRINCIPAL QUEoTI01-b OP THE THEORY OF ADAPTIVE CYBERNETIC 

CONTROL SYUTELb 

A.G.Ivakhnenko, Kiev, USSR 


Analogy of Basic Schemes of Conventional and Cybernetio 


Stabilization systems with constant sotting date from the preoy^* 
bernetic period. Under " cybernetic _aystem" we shall understand systems 
designed for more complicated tasks than the classical ones of stabi- 
lization, program systems or servomechanism, particularly systems 
with self -changing (or adaptation) of such characteristics as* a) re- 
ferences, b) program, c) parameters, d) law of following or nonlinea- 
rity (from type "S" to "N"), e) algorithims, f) probability, g) region 
of action, h) impulses, i) structure, etc. 

When adaption is evaluated by one figure of merit ^ , all 

systems may be realized by employing the same basic scheme with only 
some variations. The cardinal difference lies in the principle of act- 
ing. It is possible to emloy the principle "by disturbances" or the 
feedback principle ("by output") (fig.1). Combined systems uniting 
""both principles are the moat perfect. The theory of combined systems 
of stabilization /4/, elaborated for conventional unadaptive systems, 
may with some alternations be applied to combined cybernetic systems. 
In this paper we consider extremum systems, which automatically find 
the maximum and minimum of the only figure of me^it $ , and are the 

most developed examples of cybernetic systems. The reader is aasumed 
to be familiar with four principal ehemes of extremum regulators /4/ , 
Advantages of Combined ^y®^®®.® * teady S' 1 ate Regimes 

Energetical^ advantages. The output power of the feedback (or 
"corrector" ) may be taken about five times less than in systems with- 
out compound links after disturbances, the disturbances being equal. 
The higher the requirements of rigidity of the system, the greater 

the anergetical advantages o the combined systems /4/, 
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^b«rMUc_adyantage«. The setting of the combined systems of 
stabilisation is fsoiiitstod and extended. Ths real static characteris- 
tic aaV differs from the astatic OgO^Og'. »® «•* • «yBtem having 

(which is necessary for the voltage drop compensation in a li- 
ne) or a system having very high values of both rigidity and statism 
(which is necessary for parallel work of objects). 

Extremum systems have a servomotor. The olftsest analog is a system 
of stabilisation also possessing a servomotor, iffe can consider the 
geometrical plaoe of the extrema in the space L<PM as the astatic 
characteristic OgOgO** and the place of real work (or^the hunting 
centre positions) as the statioal characteristic A A*A 1 MMle the mani- 

t 

pulated variable* L - the mafin disturbance, iet us approximate the 
extremum characteristic by a parabola (table 1), We find the equations 


of statical characteristic A k k (table 2) , and estabilisht 

kt <h - n 

1) if 1 Q - 0* c Q -0. b^*0» n o «0, we have Z -m o T , dM - dM 
and the system is identical witfc an astatic one and the characteristics 

AAY and OgOgOg coincide. I 

2) Another way for changing the statical characteristic position 


is tttfnake use of the compound links 1 ocd 1 0 * Here it is possible to 

Aa • 

eliminate the statical error only in a regimes without error 1 aerlee 


/4/. where 1° -A (for conventional systems 1„ - ^ 


) when 1 0 * Of 


b^ * 0. 

Let hods of Objective petection of Disturban ces sad 
Manipulated Variables and Calculation of the "Opt imum 
Compound Characteris tic" 

To Eliminate the steady state error Ai in all regimes without 
exception we must apply a specially selected nonlinear compound link, 
characteristic of which we call the "optimum compound characteristic". 

The method of obtaining such nonlinearity is elaborated in^/5# 6/# 
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It is interesting to work out an objective method of detecting 
disturbances end manipulated variables* In the general aspect it means 
a method that can furnish a reply to the questions which elements are 
best manipulated in a system — parameters or nonlinearity* structure 
or codes of impulses* etc? There are no such methodd as yet* A more 
limited problem consists in settling which of the parameters it is best 
to change in order to get a more perfect extremum. Here# the optimum 
transient response may be found by the statistical methods of Wiener 
/Q/ Booton and others* If difficulties are met, some rough approach 
may be used# correcting by experiment (appendix 1)# since this gives 
t precise answer to the question of the choice of disturbances and 
manipulated variables and the existence of extremum* 

Optimum cla ract eristics have to be known only when constructing 
systems acting "by disturbances"# bhen constructing feedback syseteme* 
it is sufficient to know whsther the extremum (for example, the mini- 
mum of error) exists or not. 

Servomechanisms which self change the gain dependidng bn the 
frequency and amplitude of the sign»varied signal .(fig*1) were tested 
experimentally. Such signals are received by accommodation systems 
so-called correction servomechanisms working in combination with 
opened control. It has been established that cybernetic systems 
acting "by disturbances" (fig,1 a) can work stably with a very high 
average gain factor# several times higher than the value obtained fro* 
the stability conditions of conventional, unadaptive systems. As soon 
as the frequency or the amplitude of signal decreases* the system 
automatically returns from the precise following regime with high 
gain* to the noise "smoothening" regime with low gain* the dynamic 
error decreasing by about 50 per cent* 

N 
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Rules for Selecting Schemes of Control Systems 

1 ) when all the noises may be measured and the amplifier charao— 
teri sties are stablefrhere is no necessity for using any feedback. 

It is sufficient to use open*cycle control "by disturbances"* settled 
by the "conditions of invariantness", 

2) When the noises cannot be measured we must use the closed sy^» 
tem of feedback, settled by compromise setting or by statistical cri- 
teria. 

3) when only a part of the noises may be measured* or when all 
the noises are measured but the gain characteristics are not suffici- 


ently stable, we have to> use Combined system, settled "by parts" /4/* 
She setting is meant to include the choice of parameter values as well 
as the synthesis of the scheme by employing new elements. 

These rules hold for conventional unadaptive systems as well es 
for cybernetic extremum systems. The latter systems have easier con- 
ditions of noise measuring. It is not necessary to measure the noise 
itself, it is sufficient to measure some generalized parameters (for 
example the frequency k, noise to signal relation J— etcj). For 
periodical noise measuring* the signal can be shut off for a very 
short time (the method of "test impulses")! moreover in combined sys- 
tems this is more frequently permissible than in uncomblned /5» 6/» 

In the case when cybernetic control is applied to a conventional 
control system* we are able to consider the cybernetic regulator as 
secondary* supplementing the basic, system for improving its operation - 
It may act on the feedback cycle of the basic system as well as on 
its open»oycle. To the secondary cybernetic regulator may be added a 
cybernetic regulator of the third order* adapting the characteristic^ 
of the secondary regulator* eto. Each such regulator achieves a cer- 
tain step in the Iterations! solution of the control task (the 
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^■sthod of successive approximations)* When the system actes ideally 
(for example t when it is settled by the conditions of invariantness) 
the accessory cybernetic regulator is unnecessary* 

Advanta ges of Combined Systems in Dynamic Regimes 
If, on talcing into account the hunting error, the total error of 
the system is A — Ai+Ax+ A 5 ■+■ Av , where Ai is the statical error, A* 
the transient error, A 3 - the hunting error, Av - the speed error* The 
combined system has the following advantages in transient responses: the 
applicability of the invariantness conditions increases, which permits 
the elimination (or decrease) of statical, transient and speed errors, 
i*e* the increase of the speed and precision of the system* In contra- 
distinction to the systems acting "by disturbances" only (also possess- 
ing great possibilities for satisfying these conditions), a high rigidi- 
ty S«1+o(pmay be attained in combined systems, which eliminates errors 
due to noise for which there are no compound links* 

On testing the extremum regulator of the ( f^f f ^ ) ratio, acting on 
the (f|j§j) relationship, developed at the Electrical Engineering Insti- 
tute of the Ukrainian Academy of Sciences for steam boilers, the non- 
combined system was found to be impracticable (see the Ukrainian jour- 
nal "Avtomatikm", No* 2, 1939)* 

Raising of P reci sion and Speed by Improvin g Co mpcun d LinkB 

"b y Disturbances " 

The fundamental law for setting links "by disturbances" is satis- 
fying the so-called invariantness conditions* Let a linear system be 
described by the equation P) *&=$■»> (p) + $ 3 (p)Ln + •» • 

where a^(p) and b^(p) are polynomials wibh of order n and m res- 

pectively is the controlled variable; and are disturbances* 

Then the conditions of invariantness can be written in the four forms 
presented in table 3 * 
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The movements of the hunting centre ef nn extremum eyetem with 

f : 

referenee self-changing la described by linear equations with constant 
coefficients In derivatives or differences. For other systems (e.g. the- 
se with variable parameters) these equations are the first approach 
which Is more precise when the departures of the centre are less, 
Bxtremal continuous test signal systems are. In essence, systems of 
stabilization of phase discriminator output voltage (possessing serve) 
at a constant value dose to sere (fig,4), in systems having serve we 
must distinguish measuring l(p)L and power (direct) l'(p)L compound 

*) 4 > C5 

links. The former acts on the amplifier Input, and the latter-direotly 
on the objects In conventional systems and in extremum systems with 
continuous test signal for satisfying the Invariantness conditions, it 
Is possible to ohoose l(p) and 1 (p). The oholse of 1 (p) Is reoemon— 
ded in autohunting and output sampling systems (appendix 2), To satle- 

m ft 

fy condition (2). To satisfy condition (2 ) it Is sufficient that the 
optimum oompound characteristic and the direct link should be linear. 
The other elements (e,g, servo) are not involved in the error compen- 
sation and thus it does not matter what equation they have. 

The Idea of complete invariantness belongs to Prof ,G,V,Shcipanev 
/I/, The possibility of the physical realization of dynamic systems 
(bridge schemes) satisfying the Invarlantness conditions was establ- 
ished by Acad,V,S,Kulebakln /2/. Automatic oontrol sydtems (distin- 
guished by unilateral action) were shown by the author to satisfy the 
Invarlantness conditions /3/» I, R, Moors' a paper /10/ belongs to this 
trend too. Thus, the practical value of the invarlantness theory has 
been proved. Prof, G,V,Shcipan©v'e error consisted in assuming the 
possibility of completely eliminating error in "by output" or feedback 
systems, whereas in such systems it is only possible to eliminate the 
stable components of the error by Increasing the degree of astatism 

(fora 3a), The latter was eatabilished for uniform motion and unifora 
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acceleration toy K.Minorsky /9/* The rest of the invariantneae condi- 
tion forma (except 3a) may be eatiefied in combined eyetem and in 
ayeteme "by diaturbancea" only. 

The firet extremum regulator acting "by diaturbancea" was cons— 
atruoted by V.A.Bogomolbv and Y.L.Benin at the Electrical Engineering 
Inatitute of the Ukrainian 8SR Academy of Sciencee /4 /, and an extra- 
mum regulator with feedback was firat described in / 1 5/# The firat 
considerable extremum oyatem analyses were made by V.V.Kcsakevich 
(1948) and then by Draper. Li and Lining (1951 ). The eyetem of eteam 
boiler efficiency regulator mentioned above, developed in 1958 at the 
Electrical Engineering Institute of the Ukrainian SSR Academy of 
sciencee / 5 /» in the firet combined extremum eyetem. 

Raisin g Pr ecision an d Speed b y Improving Fe edback Loor» 

The fundamental law for setting' the feedback loops of combined 
ayeteme ia the condition of "compromise setting", when the gain ia 
ohoaen so that with a aufficient rigidity S = sufficient 

stability (e.g. c 12 * 0 . 25 ) ia attained, statistical methods of opti- 
mum transfer function selection may be applied for the earns purpose. 
It must be kept in mind that in ayeteme with servo the ratio 

t npa ad ). called the "figure of merit", serves as rigidity men— 

1 speed error ' w 

sure! and the so-called "degree of stability" /4/ servee as a 

stability meaoure. In the oeae when • conventional contr*l system la 
need ae an cybarnetlo oontrol objeot compromise setting, or statistic 
eal methods, are employed twioei once, to the main eyetem, and then 
to the cybernetic regulator itself. The peculiarity of the cybernetic 
regulator feedback loop ayntheela ooneleta in easy signal ohanging, 
and the feedback loop eohame and parameters are subject to small oho* 
gee only, whereas in conventional eyatema the feedback loop feheme 
snd parameters are varied (appendix 3). 
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The basic methods of week signal reception when noises are pre- 
sent! employed in modern communication systems# are applicable in ex- 
tremum systems as well (figs. It 2# 3* 4 ) . a peculiarity is the appli- 
cation of correlation functions of the "relay type" 

Instead of the usual proportional type /5/. This permits slmpfllfying 
the apparatus! If the rise in the noise proofing attained by the oross 
correlation method is taken as unity# the effect yielded by other 
methods! with an equal speed of system may be estimated by the follo- 


wing tablet 

— method of autocorrelation .0, 8-0*9 

— method of cross correlation 1*0 

— method of integration (accumulation) * 1#0 

— methods of cross correlation and of 

signal filtration simultaneously 1.1— 1*2 

— method of signal complication 

( d igit a l r a di olo cati o n^ over 1*5 


This order of methods holds for both open channels and when 
allowing for feedback* These figures have been substantiated by tests 
on the MB— 7 model* The correlator eliminates disturbances on the sa- 
me principle as the synchrodetector* The advantages of the signal 
complication method are accounted for by the fact that it increases 
the quantity of information! a complicated signal being more readily 
distinguished from interference than a simple one* An example of a 
system giving K and 1 letter signals (in Moroe oode) is shewn in fig. 4 
Since the signal complication method has not been worked out as yet# 
and the integration (accumulation) method is rather oemplloated# the 
cross correlation method is best for praotloal purposes /fig* 28/* 

The baslo apparatus necessary for effecting this method is new being 
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produced aerially (e.s. BT« regulator of the W -type) /5/. Bxtnmrn 
CO, trol systems. contracted on the baai. on thie universal regular. 
rtU differ from one another only by the measuring element, produotlng 
d.c. voltage proportional to the -figure of merit- (of the extremum) 

^ ’ Qr^hp ranality < ben-correlation ' »f tg s » ulng MatbM * 

then the conditions obtained below <)**£(*) i Z ^~° 

on i) Si,(p)=ji(p)+£ (p)+ y, (p)Yi (p)~p £(p) - o 

are aatiafied, the methods of increaalng preoieion and epeed by impro- 
ving disturbance links are connected with the choice of ooeffioiente 
of the right side of the system dynamics equations! and the methods 
ef improving dosed loop., with the choice of coefficient, of the 
left side (fig.5. showing thie, is taken from 73/ . The effect ef 
compound links on the stability is not great. The setting of both 
basis and secondary (cybernetic) combined systems may be effected by 
the -by parts- method t first, maximum improvement of the olleed feed- 
baok loop, and then second, ef the open compound link, by disturbs 


006 and noises* 

Appendices sad Tables 

. j-p—aw 1 . rt ample of m ethod of Choosing Input Variable s,. 

A servesystem which i. to be the object of cybernetic control 1. 

described by equations of dynamics 

Z" = iS*- <P- rrxpP 

(%p^)p<p 


The system is noted upon eimultaneosly by signal and noise, 
i $(t)=yr(t)+A/(t) . Applying the rough epproaoh method of 

O.Dutile /a/, we find that the minimum error is attained when the spot 
tral densities of signal and Interference are equal i <Sv(<*k) - & (lik) 
where u)rCJc is the out (or limit) frequenoy of the eloaed 

„ /, *< 

system* ^^{ LU )--rr (2K) l +u) x 
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is the slgn«varied iqutri signal 
(oO) — Q* is * be whit# noise* 

As tbs ssoond design squstlon is an expr&lon (sr plotted funotlen) 

for the out frequenoy, obtained from the above equations of tha systaa 

/ 

element# . 

v/heze ; '*p=°(< 0( * (*) 

Solving (1) end (2) graphic ally ve find the monogram /5* 6/« 

J-i ( ktC< z /u) o) 

This monogram answers the following questions* 

J, What variables are to be considered as disturbances and k)? 

2, What parameters are to be manipulated ( 0^2 andt^ Q )? 

Thus, the rough approach gives exact answers to the principal 
questions* The mom gram also makes it possible to determine approxi- 
mately the "optimum compound characteristic#" C^-'Cof-Q-i *) 
and u) - £ ^ 1 /C ) • The,e characteristics may be nnde mor# 

precise by experiment afterward#* 

A ppendix 2. Choice of Cempound Lin k s Coefficient# by Invariants# # # 

condition# 

For the system of stabilisation described by equations* 

control law* 2 — V r '~ M fP) &(P) ^ 

amplifier and serv#* M =■ V* (P)-p-Z. / 

object* & (P)M-MP)L +t(r)L 

load (controlled system)* ~£~ - /£ {P) 

we obtain the following characteristic^ eouation < f ° r th# vmriablt 

, \ \f \V \ ' ) J h (P)+£(ti+ Yx(P) pc (p) __ p 

?): i+l(p)Y*(p)m(p)+ JTfi 

econd form of the invariantnese conditions* 

/I i A i Ai 


tJ 


Whence 

when 

when 


}1 bUO ww — 

?(p)+£(p)+ y 'i(p)Y*(p)j-£(p)=o 
e'(P)=o fi(r)+ w ii(e)j>£(p)=o 

£(p)--° P(p) + l'(p)=0 


(*') 

fx"\ 
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We determine! 1, Conditions 2* and/ 2 9 may be realized only la 
eyeteme where the oholoe of l(p) or l\p) le possible, i.e. la combined 
systems and In systems acting by disturbances, 

2, Compound links l(p) and l*(p) may be considered as opened and 
fail to affeot the stability only in case of the Invariantness condi- 
tions being satisfied or then 2(p) «<=o , in /4/ the case is considered 
when Z(p)«A>-»- C<P , and error overoompensatlon is found to 

result in hunting (auto«osclllatlons), / 


Por an extremum system with continuous test signal the following 
equations hold! 

control law! £, = - ©+ 

amplifier! U = Y v (p) J 

servo! M =S ii(p)^U 

Linear part of object! Mi = Vi (p) £M+ 

nonlinear part of object! (*P+<P 0 ) = - Q fM<- 

phase discriminator (correlator) t Y 3 (p) J 

where *£ 0 = + C 0 + fiL 

Por variables ^ , Q , U , M and Mi , there is a closed system 

of linear equations. Let for Instance VCfpJs Vi Y* Y, Vy # — — =^Tp+i 

t(P)=0,C o =0 Then we obtain! (p*+Q, p + Q % ) 0 *(S 0 p*+ pi°jC] L 
Let us take nondlmenslonal timing! u) c -\[q x T=U)ot ' d. 

(2> l +Z C a V+l) ( f t D\ JD+ljL ' wh«r« cj_i 

Solution ! 1 ) When L -M: B £ * (d CCJj T+ 0$infi, x T); * ^ 

»h.r. — 

2) w Un L^yt 6 = tT-&H+ £(<* TV Sfi 0 & a T ) 

where 0 ,= A« = 2 C„ tLzj/L 

Invariantness conditions! ]f* s ">« ^= 2 C a f 0 

Transient response forms, with A v =0 t are shown in figure 5, 


This example shows the selection of measuring link coefficients l(p). 
Let us also consider the ohoosing ef direct link coefficients l*(p). 


It is necessary to distinguish two cases! 
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1. The object consists of inertial «nd nonlinear parts ,The opti- 
mum compound characteristic is known: 

l(p)CM+e'(P)LJ and H= 5,4 

Then in order that when is varied, servo should not be 
switched on, it is necessary that t / t t 

/i a =ro, e'(p)=^i--= p+C p n 

2. In an object equivalent circuit, the nonlinear part is pieced 

first, and then the inertial* In this case for a continuous test sig— 
system we obtain. 

control laws — Q + & (p) L 

amplifiers U—V , *(P)£. 
servos M 

nonlinear part of objects (. Mi— Mo) ~ — Q ( 
linear partV>bjects Vx(P)Mi 

phase discriminator (correlator) s Vs (p) Pis. 

where L or JE* 0 = : Co+J2>*(Aa)+ £ 0 (Li) 

In this case for complete lnwarlantness, it la sufficient to use com- 
pound follow-up link, chose# in accordance with the optimum compound 
characteristic (when l(p)*0), ( / 

Per a linear systems Z*o= Co *^$0 ^oZj— COOSt, or Jio~ 

for a nonlinear systems ho = c 0 + fit- ii(L) = const. orj3cfi)= c(L) 
In /5, 6/ a method ie developed for choosing direct compound 
nonlinearity, u id the approximate replacement of the by several dlntuft. 
bances link, (Li LxL% • • . . Ln) ^ by a simpler sum of links s 

£ H m+u(Lj+eL(L x )*-*t»(u) is discussed. 

Appendix 3* Example of Applying the Statistical Method 
Let the extremum regulator with forced hunting (l*e, with modu- 
lation or output sampling) change the manipulated variable M by the 
square ilpuleee law. The autocorrelating function of such a signal is 
£ where k ie the frequency. This variable 

together with Interference of "white noise" type, for which 
An IT) -a 1 , passes through a circuit (consisting of an object 

and measuring elements) the impulse function of which is known, o.g. 

T (first order object). For better noise*proofing 

of the system it is necessary, that the interference to signal ratio 

on the measuring element input should be as small as possible. Using 
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fornul« in a form obtained In Jones* paper /tJ/ «e find* 


v/(i)4J/iN or 


tut 




£V 


The practical conclusion from thin example consists in the choice 
of the optimum number of Galtchlng8«ln of the nerve per unit of 
time K4 Jz 


TAliLB 1 


lee of regulation 


Equations for otoadjr^otate roglmqe 
"Por ntab llTgutlon eye temp ”I-or extremum tiyCTW 

Z.^-m t 4>-n 0 M + l! 0 L + kY' I, --rn 0 <P-n fi M-*tJ, 


regulator with propor- 
tional speed pM ~ ~ ® 


Object of regulation <p = <^/ ^2 ~ ft h 

where t 

Z, r M + l L 


*L = 0 

_y/y 

•'•'or b,tb,L 
jj - £l 


TABLE 2 


statical charact rl en- 
tice 


.stabilisation eyotem 


extremum oyotem 


In plane &-d. 


where i = 


<x,m e +n 0 


Y 


+ _ - d, to)_S_ &o 

* 1 cL, 1 n o 


where* 

+ n ° 


2q rn 0 

J, =/>-*•' 


In plane Q -A* 


<P=<r o -6;M <pz(T 0 -<r,M 

-o 


(T - Hill ) ~d,@« 


Si 


In plane <P —1 


.? _=jf • ^ 


v>her ® 


* d , m o + n c A 

x-,~* k'*r , Jz eL ' 1 


r 


^f L . 
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